Conversation assistance system

ABSTRACT

Systems and methods for providing conversation assistance include receiving from at least one user device of a user, conversation information and determining that the conversation information is associated with a conversation involving the user and a first person that is associated with first conversation assistance information in a non-transitory memory. Body measurement data of the user is retrieved from the at least first user device. A need for conversation assistance in the conversation involving the user and the first person is detected using the body measurement data. First conversation assistance information associated with the first person is retrieved from the non-transitory memory. The first conversation assistance information associated with the first person is provided through the at least one user device.

CROSS REFERENCED TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.15/495,719, filed Apr. 24, 2017, which is a continuation of U.S.application Ser. No. 14/869,558, filed on Sep. 29, 2015, and issued asU.S. Pat. No. 9,635,167 on Apr. 25, 2017, the contents of which areincorporated by reference in their entirety.

BACKGROUND Field of the Disclosure

The present disclosure generally relates to mobile communicationnetworks, and more particularly to a conversation assistance system thatmay provide conversation assistance to users using mobile communicationdevices.

Related Art

People can now communicate and interact with more people than everbefore. To keep in contact with friends, business associates, and/orother relationships, people are increasingly joining social networks andsharing various types of information via those social networks. Forexample, people may share family information with others that they areconnected to via friend networks such as, for example, those provided byFACEBOOK®, and share business information with others that they areconnected to via business networks such as, for example, those providedby LINKEDIN®.

However, while people are more connected than ever before, it cansometimes be hard for a person to remember the name or other informationof another person when interacting with that other person (e.g.,particularly when that interaction is unexpected or the previousconnection was brief or distant), which can make it difficult or awkwardto start or carry on a conversation. Conventional solutions to thisproblem include the person attempting to search the Internet to retrievefor information about the other person (e.g., from a social network) ona portable device. However, such searches are time consuming and caninterrupt a conversation that has already begun with the other person.

Thus, there is a need for a conversation assistance system thataddresses the issues detailed above.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a flow chart illustrating an embodiment of a method forproviding conversation assistance;

FIG. 2 is a schematic view illustrating an embodiment of a user devicebeing used by a user in a conversation involving the user and a firstperson;

FIG. 3 is a perspective view illustrating an embodiment of a userdevice;

FIG. 4A is a screen shot illustrating an embodiment of a user devicedisplaying a conversation assistance settings screen;

FIG. 4B is a screen shot illustrating an embodiment of a user devicedisplaying a conversation assistance settings screen;

FIG. 4C is a screen shot illustrating an embodiment of a user devicedisplaying a conversation assistance settings screen;

FIG. 4D is a screen shot illustrating an embodiment of a user devicedisplaying a conversation assistance settings screen;

FIG. 5A is a schematic view illustrating an embodiment of a conversationassistance system;

FIG. 5B is a screen shot illustrating an embodiment of a broadcast userdevice displaying a broadcast settings screen;

FIG. 5C is a schematic view illustrating an embodiment of a conversationassistance information database in a conversation assistance system;

FIG. 6 is a screen shot illustrating an embodiment of a user devicedisplaying a conversation assistance information configurations screen;

FIG. 7 is a screen shot illustrating an embodiment of a user devicedisplaying conversation assistance information associated with a singleperson;

FIG. 8 is a screen shot illustrating an embodiment of a user devicedisplaying conversation assistance information associated with multiplepersons;

FIG. 9 is a schematic view illustrating an embodiment of a conversationassistance information database in a conversation assistance system;

FIG. 10 is a schematic view illustrating an embodiment of a networkedsystem;

FIG. 11 is a perspective view illustrating an embodiment of a userdevice;

FIG. 12 is a perspective view illustrating an embodiment of a wearabledevice;

FIG. 13 is a schematic view illustrating an embodiment of a computersystem; and

FIG. 14 is a schematic view illustrating an embodiment of a systemprovider device.

Embodiments of the present disclosure and their advantages are bestunderstood by referring to the detailed description that follows. Itshould be appreciated that like reference numerals are used to identifylike elements illustrated in one or more of the figures, whereinshowings therein are for purposes of illustrating embodiments of thepresent disclosure and not for purposes of limiting the same.

DETAILED DESCRIPTION

The present disclosure provides systems and methods for providingconversation assistance to a user for a conversation involving the userand at least one other person. Various user devices may be used during aconversation by the user with a person, and may be configured to captureconversation information, including body measurement data of the user.In some embodiments, the body measurement data may include heart ratedata, temperature data, and/or perspiration data. The conversationinformation from the user devices may be determined to be associatedwith a conversation involving the user and the first person, and may beused to automatically detect that the user needs conversation assistancein the conversation. Information types of conversation assistanceinformation that the user needs may then be automatically anddynamically determined. For example, it may be determined that the userneeds information about the family of a first person when the firstperson starts to talk about his family. Determined conversationassistance information may then be retrieved and provided to the user.In some embodiments, the conversation assistance information is providedaccording to a conversation assistance information configuration. In oneexample, the conversation assistance information configuration mayprovide for the display of an image that is associated with the name ofthe first person in order to help the user remember the first person'sname. However, these embodiments are meant to be merely exemplary, andone of skill in the art will recognize that a variety of modificationsmay be made to the conversation assistance system discussed belowwithout departing from the scope of the present disclosure.

Referring now to FIG. 1, an embodiment of a method 100 for providingconversation assistance is provided. The method 100 begins at block 102where conversation information associated with a conversation isreceived from an at least one first user device used by a first user.Various embodiments of one or more user devices may be used during aconversation, and the first user device may be configured to capture theconversation information associated with the conversation by itselfand/or via communication with others of the user devices. In someembodiments, the conversation information may include body measurementsdata (e.g., heart rate data, temperature data, perspiration rate data,and/or any other data that may be captured via body measurements),gesture information (e.g., interaction gesture information, hand gestureinformation, and/or other gesture information), audio information,location data, and/or a variety of other information that may be used toidentify, characterize, and otherwise analyze the conversation. At block102, in some embodiments, the first user device may save theconversation information and/or send the conversation information over anetwork such as, for example, the Internet. For example, the first userdevice may send the conversation information to a system provider devicethat operates to provide the conversation assistance system (e.g., aconversation assistance system provider device operated by aconversation assistance system provider, a third-party system providerdevice operated by a third-party system provider, and/or any otherprovider of the conversation assistance system). However, in someembodiments, the conversation assistance functionality discussed belowmay be performed by the first user device without the need for a networkconnected system provider device.

Referring now to FIG. 2, an embodiment of a first user device being usedin a conversation is illustrated. In the embodiment illustrated in FIG.2, only one person other than the first user is illustrated as aparticipant of a conversation. However, in some embodiments, multiplepersons other than the first user may participate in a conversation,which will be discussed in detail below with reference to FIG. 8. Asillustrated in the embodiment of FIG. 2, a first user device 204 isbeing used by a first user 202 during a conversation 200 with a firstperson 206 that, in the illustrated embodiment, uses a broadcast userdevice 208.

In the illustrated embodiment of FIG. 2, the first user device 204 andthe broadcast user device 208 are wearable devices (e.g. smart watchessuch as, for example, the Apple Watch® available from Apple Inc. ofCupertino, Calif.). However, the first user device 204 and the broadcastuser device 208 may be other types of devices (e.g., other wearabledevices such as smart glasses, mobile devices such as phones, etc.)while remaining within the scope of the present disclosure. In someembodiments, the broadcast user device 208 may be substantially similarto the first user device 204. In some embodiments, the broadcast userdevice 208 may be a device of a type that is different from the firstuser device 204. In some embodiments, one or more first user devices 204may be used by the first user 202 (e.g., a plurality of wearabledevices, one or more wearable devices and a mobile phone, etc.). In someembodiments, the first user 202 may be in a position during theconversation (e.g., facing the first person 206) such that the firstuser device 204 (e.g., smart glasses) may capture images and/or gesturesof one or both of the first user 202 and the first person 206.

FIG. 3 illustrates an embodiment of a first user device 204 that may beused in conversation 200 by the first user 202. As illustrated in theembodiment of FIG. 3, the first user device 204 includes a camera 302, aperspiration sensor 304, a heart rate sensor 306, a motion sensor 308,and a display 310. The first user device 204 may also include a GlobalPositioning System (GPS) device, an accelerometer, a temperature sensor,a microphone, a wireless communications device, and/or any othersubsystems that may be utilized to capture the conversation informationdescribed herein.

In some embodiments, the first user 202 may instruct the first userdevice 204 when to begin capturing the conversation information (e.g.,via a voice command, a selection of a physical or graphical input,etc.). In some embodiments, the first user device 204 may continuouslycapture the conversation information at an event (e.g., a birthdayparty, a business conference) where conversations may occur based on,for example, recognition of the event in a user's calendar, based on alocation and publicly available information on the Internet, etc. Insome embodiments, the first user device 204 may be informed (e.g., bythe first user 202) or may automatically recognize the beginning of aconversation 200 (e.g., based on detected audio, detected gestures,and/or other conversation initiator information known in the art), andin response, may begin capturing conversation information until thefirst user device 204 determines that conversation 200 has ended (e.g.,via detected audio, detected gestures, and/or other conversation endinginformation known in the art).

In some embodiments, the conversation information may include locationdata indicating the location of the first user 202. In some embodiments,the first user device 204 provides location data based on the locationof the first user 202 and/or the first user device 204. For example, thefirst user device 204 may include a location determination device (e.g.,a Global Positioning System (GPS) device, a cell tower triangulationdevice, a Wi-Fi location determination device, and/or a variety of otherlocation determination devices known in the art) to determine locationdata related to a current location of the first user device 204. Forexample, the first user device 204 may be a mobile phone or wearabledevice that changes locations as the first user 202 moves, and mayprovide the current location of the first user using the locationdetermination device discussed above. In some embodiments, the firstuser 202 may be prompted by the first user device 204 to provide itscurrent location. In some embodiments, a system provider device mayretrieve the conversation information that includes the locationdetermined by the first user device 204 over the network.

In some embodiments, the conversation information may include bodymeasurement data of the first user 202. For example, the first userdevice 204 may provide perspiration data of the first user 202 capturedby the perspiration sensor 304 of the first user device 204. In anotherexample, the first user device 204 may provide heart rate data of thefirst user 202 using a heart rate sensor 306 of the first user device204. In yet another example, the first user device 204 may providetemperature data of the first user 202 using a temperature sensor of thefirst user device 204. While a few specific examples of body measurementdata have been described, one of skill in the art in possession of thepresent disclosure will recognize that any of a variety of bodymeasurements may be made and provided by the first user device 204 whileremaining within the scope of the present disclosure.

In some embodiments, the conversation information may include audioinformation that captures one or more statements (e.g., spoken by thefirst user 202 and/or the first person 206) during a conversation 200.In some embodiments, the first user device 204 may be configured toreceive audio information from the first user 202 and/or the firstperson 206. For example, a microphone or other audio capturing system inthe first user device 204 may be configured to capture audio informationof statements made by one or both of the first user 202 and the firstperson 206. In some embodiments, a speech recognition engine (e.g.,provided by a processing system executing instructions on a memorysystem) in the first user device 204 may be configured to analyze theaudio information to recognize the corresponding statements. While theanalysis of the audio information to recognize the statements has beendiscussed as being performed in the first user device 204, in someembodiments, the audio file may be sent to the system provider deviceand then analyzed by a speech recognition engine in the system providerdevice to determine the corresponding statements while remaining withinthe scope of the present disclosure.

In some embodiments, the conversation information may include gestureinformation corresponding to a gesture of the first user 202 and/or thefirst person 206. In some embodiments, the gesture information mayinclude interaction gesture information corresponding to an interactiongesture (e.g., a handshake, a hug, a bow, a kiss on the cheek, and/orother interaction gestures known in the art). In one example, theinteraction gesture may be a gesture of the first user requestinginteraction with the first person 206 (e.g., a gesture to request ahandshake by extending the right hand towards the first person 206). Insome embodiments, the gesture information may include hand gestureinformation corresponding to a hand gesture (e.g., an “ok” hand gestureusing a thumb and a forefinger of the hand) of the first user 202 or thefirst person 206. In one example, the hand gesture may be made byextending a specific number of fingers in a direction parallel to a topsurface of the first user device 204.

In some embodiments, the first user device 204 may capture gestureinformation corresponding to gestures provided by the first user 202and/or the first person 206. For example, a camera 302 in the first userdevice 204 may capture an image or video corresponding to gestures ofthe first user 202 and/or the first person 206. In another example, amotion sensor 308 (e.g., an accelerometer) in the first user device 204worn on the wrist of the first user 202 may capture movement data (e.g.,up-and-down motion indicative of hand shaking) associated with a gesture(e.g., a handshake). In some embodiments, a gesture recognition engine(e.g., in the first user device 204, service provider device, or anyother device) may be configured to analyze the gesture informationincluding the images, videos, motion data, and/or other gestureinformation to determine the gesture performed by the first user 202and/or the first person 206.

In some embodiments, the first user device 204 may include other sensorssuch as position sensors, muscle tension sensors, network communicationdevices, and/or a variety of other sensors known in the art that may beused to determine and transmit conversation information, and as such mayprovide other functions related to conversation 200. In an example, amuscle tension sensor may be used to capture gesture informationcorresponding to a gesture (e.g., gripping a hand during a handshake).In another example, a wireless communication device in the first userdevice 204 may be used to transmit and receive information (e.g.,conversation information over the network).

A variety of devices may be suitable for implementing the first userdevice 204. As discussed above, the first user device 204 may be awearable device (e.g. Google Glass® available from Google Inc. ofMountain View, Calif.; Apple Watch® available from Apple Inc. ofCupertino, Calif.; etc.). However, in another example, the first device204 may be a mobile phone or other mobile computing device known in theart. One of skill in the art will recognize a variety of otherportable/mobile user devices and/or wearable user devices may beutilized, in at least some embodiments, without departing from the scopeof the present disclosure.

In some embodiments, the first user 202 may use the first user device204 to provide the system provider device with first user information ofthe first user 202 over the network. For example, first user informationof the first user 202 may include a user name, a user identificationnumber, a user account number, a user password, login information ofvarious social networks, and/or a variety of other information known inthe art for associating the first user 202 with a first user account. Insome embodiments, the first user 202 may sign into an account with thesystem provider device before or during conversation 200.

In some embodiments, similar to the first user device 204, the broadcastuser device 208 may be used by the first person 206 to provide thesystem provider device with first person information of the first person206 over the network. As such, the first user device 204 may receivefirst person information of the first person 206 from broadcast userdevice 208, and send the received first person information of the firstperson 206 to the service provider device. In one example, the firstuser device 204 may be configured to receive information broadcast bythe broadcast user device 208 when the first user device 204 is within apredetermined distance of the broadcast user device 208 (e.g., aconversation distance of approximately 4 feet). In another example, thefirst user device 204 may receive the first person information of thefirst person 206 from the broadcast user device 208 when the first user202 is within the broadcast range of the broadcast user device 208. Inanother example, the first user device 204 may receive the first personinformation of the first person 206 from broadcast user device 208 whenthe first person 206 provides an instruction to do so (e.g., by pointinga hand or the broadcast user device 208 in the direction of the firstuser 202). In another example, the first user device 204 may receive thefirst person information of the first person 206 from broadcast userdevice 208 when the first user 202 is associated with the first person206 (e.g., the first user 202 is associated with the first person 206via a social network by a second degree connection).

Thus, in some embodiments, the system provider device may receiveconversation information associated with a conversation involving thefirst user 202 and first person 206, along with user information that isassociated with a user account and/or first person information that isassociated with the first person account.

While a few example of the conversation information received from thefirst user device 204 have been provided, one of skill in the art inpossession of the present disclosure will recognize that a wide varietyof systems and methods for providing, receiving, storing, determining,and/or otherwise communicating conversation information at block 102will fall within the scope of the present disclosure.

Referring now to FIGS. 1 and 4A-4D, the method 100 then proceeds toblock 104, where a need for conversation assistance and conversationassistance information types (also referred to below as informationtypes) is determined, for example, according to the received firstconversation information, the body measurement data, conversationassistance settings, and/or any of the other information describedherein.

In some embodiments, the conversation assistance settings may be defaultconversation assistance settings provided by the conversation assistancesystem, while in other embodiments, the conversation assistance settingsmay be configured by the first user 202. As discussed below, theconversation assistance settings may include body measurement settings,region settings, language settings, interaction gesture settings, handgesture settings, audio settings, and/or settings for any otherinformation that may be captured, determined, and/or otherwise utilizedin the conversation assistance system.

In some embodiments, conversation assistance settings include bodymeasurement settings. In some embodiments, body measurement data mayindicate that a user needs or desires conversation assistance. Forexample, particular body measurements such as an increased heart rate,increased perspiration, increased body temperature, and/or otherindications of user anxiety may indicate that a user is nervous oranxious. The detection of such nervousness and/or anxiousness incombination with determinations that a conversation has begun may beindicative that the user is beginning a conversation with a person whosename (or other important information) they have forgotten or otherwiseshould know.

Referring now to FIG. 4A, an embodiment of a first user devicedisplaying a conversation assistance settings screen is illustrated. Asillustrated in FIG. 4A, the first user device 204 includes a display 402displaying a conversation assistance settings screen 404 that includes abody measurement settings section 406. The body measurement settingssection 406 may include body measurement settings 408 a, 408 b, and 408c, each of which includes a body measurement type 410, a reference 412,a criterion 414, and an enablement status 416. In the particular exampleillustrated in FIG. 4A, for example, the body measurement setting 408 aincludes a body measurement type of heart rate, a reference of 70 beatsevery minute, a criterion of greater than 85 beats per second, and anenablement status of “YES”. In another example, the body measurementsetting 408 b includes a body measurement type of body temperature, areference of 36.5° C., a criterion of greater than 37° C. or less than36° C., and an enablement status of “NO.” In another example, the bodymeasurement setting 408 c includes a body measurement type ofperspiration rate, a reference of 0, a criterion of greater than 0.5milligram per square centimeter per minute, and an enablement status of“YES”.

In some embodiments, the first user device 204 may determine references412 of the body measurement settings 408 a-c according to bodymeasurement data captured when the first user 202 does not need or wantconversation assistance. For example, references 412 may be determinedaccording to body measurement data captured when the first user 202 isnot engaged or is not about to engage in a conversation, oralternatively and/or in combination with, the first user 202 engaging orabout to engage in a conversation, but not in need of conversationassistance. In some embodiments, the first user device 204 may determinecriteria 414 of body measurement settings 408 during a training periodwith a training set of body measurement data, which may be capturedduring previous conversation(s) where the first user 202 indicates thatconversation assistance is needed. The criteria 414 may be based on anaverage of the training set, the lowest and/or highest value of thetraining set, and/or other criterion determination methods known in theart.

In some embodiments, body measurement settings 408 may be associatedwith or adjusted according to environmental factors (e.g., a time ofday, the ambient temperature, humidity, and/or other environmentalfactors known in the art). For example, body measurement settings may beassociated with a time of day, and include a morning body measurementsetting, an afternoon body measurement setting, and an evening bodymeasurement setting, each of which may be used based on the time of theconversation 200. In another example, the captured body measurement datamay be adjusted according to a time of day to reduce possible errorcaused by environment factors. In some embodiments, the first user 202may configure the body measurement settings 408 to, for example, disableor enable a particular body measurement setting. Using the specificexample of the conversation assistance settings illustrated in FIG. 4A,if the first user 202 would like to save the conversation assistancesettings including body measurement settings 408 a, 408 b, and 408 c(e.g., on the first user device 204, on the system provider device 502,or any other device), the first user 202 may select the “SAVE” choice418 in the body measurement settings section 406.

In some embodiments, body measurement settings 408 may be updatedaccording to the first user 202's feedback regarding any conversation.For example, the first user device 204 may detect that conversation 200ends (e.g., according to audio information that includes the statement“goodbye”), send a feedback request to the first user 202, and receivefeedback from the first user 202. In another example, the first userdevice 204 may automatically detect feedback from the first user 202(e.g., according to audio information that includes the statement“conversation assistance is not needed”). In some embodiments, the firstuser device 204 may update the body measurement settings 408 accordingto the feedback received from the first user 202. In one example, thefeedback may indicate that the first user 202 did not need conversationassistance in conversation 200 when the heart rate of the first user 202was between 87 and 97 beats per minute. Accordingly to the feedback, thefirst user device 204 may update the criterion of the body measurementsetting 408 a to be greater than 97 beats every minute.

In some embodiments, conversation assistance settings may include aregion setting and a language setting. Referring now to FIG. 4B, anembodiment of a first user device displaying a conversation assistancesettings screen is illustrated. As illustrated in FIG. 4B, the firstuser device 204 includes a display 402 displaying a conversationassistance settings screen 404 that includes a region and languagesection 420 including a region setting 428 (e.g., “Japan”) and alanguage setting 430 (e.g., “Japanese”). In different embodiments, theregion setting 428 and/or language setting 430 may be automaticallydetermined by the first user device 204 using the location data of theconversation information, or be provided by the first user 202 (e.g.,“Japanese” for a special event involving Japanese guest). In someembodiments, a speech recognition engine (e.g., in the first user device204, service provider device, or any other device) may recognize thelanguage of the audio information in conversation information, and thefirst user device 204 may automatically configure the language setting430 according to the recognized language.

In some embodiments, conversation assistance settings may includeinteraction gesture settings. As illustrated in FIG. 4B, in someembodiments, the conversation assistance settings screen 404 may includean interaction gesture settings section 424, which includes interactiongesture settings 426 a, 426 b, 426 c, and 426 d. Each interactiongesture setting 426 a-d may include an interaction gesture type 428 andan indicator status 430. For example, as illustrated in FIG. 4B, theinteraction gesture settings 426 a and 426 c provide interaction gesturetypes (e.g., handshake, bow) indicating a need for conversationassistance according to the indicator status of “Yes”. On the otherhand, the interaction gesture settings 426 b and 426 d provideinteraction gesture types (e.g., hug, kiss on the cheek) that do notindicate a need for conversation assistance according to the indicatorstatus of “No”. In some embodiments, some interaction gesture settings426 (e.g., interaction gesture setting 426 c associated with a bow) areautomatically provided by the first user device 204 (e.g., according togreeting etiquette associated with a region setting 428 of Japan). Insome embodiments, some interaction gesture settings 426 are configuredby the first user 202, for example, according to the first user 202'spersonal greeting preferences.

In some embodiments, conversation assistance settings may include audiosettings. As illustrated in FIG. 4B, the conversation assistancesettings screen 404 includes an audio settings section 432 providingstatements indicating a need for conversation assistance and/or,information types needed by the first user 202. Audio settings section432 may include audio settings 434 a and 434 b, each of which mayinclude at least one statement 448 and an information type 438. In theexample illustrated in FIG. 4B, the audio setting 434 a includesstatements “Hey you . . . ,” “Long time no see,” and “Hey man . . . ,”which correspond to an information type for the name of the first person206 involved in conversation 200. In another example, the audio setting446 b includes a statement “How is life” corresponding to an informationtype for the wife and children of the first person 206 involved inconversation 200. In some embodiments, some audio settings (e.g., anaudio setting including a statement “Konnichiwa”) may be automaticallyprovided by the first user device 204, for example, according togreeting etiquette corresponding to the region setting 428 (e.g., Japan)and/or the language setting 430 (e.g., Japanese). In some embodiments,the audio settings 434 are configured by the first user 202, forexample, according to the first user 202's personal preferences ofgreetings.

Using the specific example of the conversation assistance settingsillustrated in FIG. 4B, if the first user 202 would like to save theconversation assistance settings including region setting 428, languagesetting 430, interaction gesture settings 426 a-d and audio settings 434a-b (e.g., on the first user device 204, on the system provider device502, or any other device), the first user 202 may select the “SAVE”choice 440 in the conversation assistance settings screen 404.

In some embodiments, conversation assistance settings may include handgesture settings. Referring now to the example of FIG. 4C, the firstuser device 204 includes a display 402 displaying a conversationassistance settings screen 404 that includes a hand gesture settingssection 442 including hand gesture settings 444 a, 444 b, and 444 c.Each hand gesture setting 444 a-c may include a hand gesture type 446and information type 450. For example, the hand gesture setting 444 aprovides that an “ok” hand gesture indicates the first user 202 needsinformation about the children of the first person 206. In anotherexample, the hand gesture setting 444 b provides that a hand gesture ofextending one finger indicates that the first user 202 needs informationabout the name of the first person 206. In another example, the handgesture setting 444 c provides that a hand gesture of extending twofingers indicates the first user 202 needs information about theemployer and job title of the first person 206. As discussed below, thehand gesture settings may be provided by the first user 202 to activatethe conversation assistance system discreetly such that conversationassistance may be provided to the first user 202 without knowledge ofthe first person 206.

In some embodiments, the first user device 204 may determine that aparticular gesture may be offensive (e.g., a thumb-down hand gesture)according to the region setting 428 (e.g., Japan) and/or languagesetting 430 (e.g., Japanese), and exclude the particular gesture fromhand gestures that the first user 202 may be able to choose in the handgesture settings section 442.

Using the specific example of the conversation assistance settingsillustrated in FIG. 4C, if the first user 202 would like to save theconversation assistance settings including the hand gesture settings 444a-c (e.g., on the first user device 204, on the system provider device502, or any other device), the first user 202 may select the “SAVE”choice 452 in the conversation assistance settings screen 404.

In some embodiments, conversation assistance settings may includeconversation history settings. As illustrated in FIG. 4D, the first userdevice 204 includes a display 402 displaying a conversation assistancesettings screen 404 that includes a conversation history settingssection 454 including conversation history settings 456 a, 456 b, and456 c. Each conversation history setting 456 a-c may include a lastconversation time 458, a last conversation setting 460, and aninformation type 462 needed by the first user 202. In the example ofFIG. 4D, the conversation history setting 456 a provides that if thelast conversation between the first user 202 and the first person 206happened within the last month, then the first user 202 needsconversation assistance information of information types for the wifeand children, but not the name of the first person 206. In anotherexample, the conversation history setting 456 b provides that if thelast conversation between the first user 202 and the first person 206happened over one month ago in a social setting (e.g., a birthdayparty), the corresponding information types are associated with for thename, wife, and children of the first person 206. In another example,the conversation history setting 456 d provides that if the lastconversation happened over one month ago in a business setting (e.g., abusiness conference), the corresponding information types are for thename, employer, and job title of the first person 206.

Referring back to FIG. 1, at block 104, in some embodiments, duringconversation 200 or when conversation 200 is about to happen, the firstuser device 204 may retrieve the conversation assistance settings (e.g.,from the first user device 204, the system provider device, or any otherdevice), and determine the need for conversation assistance andconversation assistance information types needed by the first user 202according to conversation assistance settings.

In some embodiments, the first user device 204 determines the need forconversation assistance according to the body measurement data of theconversation information and body measurement settings. In one example,the body measurement data of the conversation information may includeheart rate data (e.g., with a heart rate of 86 beats each minute), bodytemperature data (e.g., with a temperature of 37.1° C.), andperspiration rate data (e.g., with a perspiration rate of 0.6 milligramper square centimeter per minute). The first user device 204 may analyzethe body measurement data of the conversation information using thecriterion of enabled body measurement settings 408 (e.g., bodymeasurement settings 408 a and 408 c of FIG. 4A), and determine that thefirst user 202 needs conversation assistance because the bodymeasurement data meet the criterion of enabled body measurement setting408 a (e.g., greater than 85 beats per minute) and/or the criterion ofenabled body measurement setting 408 c (e.g., greater than 0.5 milligramper square centimeter per minute). In the particular example illustratedin FIG. 4A, the body temperature data would not be used because bodymeasurement setting 408 b associated with body temperature is notenabled.

In some embodiments, the first user device 204 determines the need forconversation assistance according to the interaction gesture informationof the conversation information and interaction gesture settings 426.The interaction gesture information of the conversation informationcorresponds to an interaction gesture of the first user 202. In oneexample, the corresponding interaction gesture is a handshake, and thefirst user device 204 may determine that the first user 202 needsconversation assistance in conversation 200 according to the indicatorstatus of “Yes” in the interaction gesture setting 426 a associated witha handshake. In another example, the corresponding interaction gestureis a hug, and the first user device 204 may determine that the firstuser 202 does not need conversation assistance in conversation 200according to the indicator status of “No” in the interaction gesturesetting 426 b associated with a hug.

In some embodiments, the first user device 204 determines the need forconversation assistance according to the audio information of theconversation information and audio settings 434. The audio informationof the conversation information may correspond to one or more statementsof the first user 202. In one example, the corresponding statement is“Hey you . . . .” The first user device 204 may determine that the firstuser 202 needs conversation assistance in conversation 200 according toaudio setting 434 a associated with the statement “Hey you . . . ”. Inanother example, the corresponding statement is “Hi James” provided bythe first user 202 or “Hi, my name is James” provided by the firstperson 206, and the first user device 204 may determine that the firstuser 202 does not need conversation assistance for the name of the firstperson 206 in conversation 200 because it determines that the firstperson 206's name (e.g., James) has already been spoken (e.g., by thefirst user 202 or the first person 206).

In some embodiments, the first user device 204 may also determine theinformation types needed by the first user 202 in conversation 200according to the audio information of the conversation information andaudio settings 434. In one example, the statement corresponding to theaudio information is “How is life?” The first user device 204 maydetermine that the first user 202 needs conversation assistanceinformation of information types associated with the wife and childrenof the first person 206 according to information types 438 of audiosetting 434 b.

In some embodiments, the first user device 204 may determine the needfor conversation assistance according to the hand gesture information ofthe conversation information and hand gesture settings 444. The handgesture information of the conversation information may correspond to ahand gesture of the first user 202. In one example, the correspondinghand gesture is an “ok” hand gesture. The first user device 204 maydetermine that the first user 202 needs conversation assistance inconversation 200 according to the hand gesture setting 444 a associatedwith the “ok” hand gesture.

In some embodiments, the first user device 204 may also determine theinformation types needed by the first user 202 in conversation 200according to the hand gesture information of the conversationinformation and hand gesture settings 444. In one example, thecorresponding hand gesture is a hand gesture of extending two fingers.The first user device 204 may determine that the first user 202 needsconversation assistance information of information types for theemployer and job title of the first person 206 according to informationtypes 450 of hand gesture setting 444 c associated with the hand gestureof extending two fingers.

In some embodiments, the first user device 204 may also determine theinformation types needed by the first user 202 in conversation 200according to the conversation history information and conversationhistory settings 456. The conversation history information may becollected (e.g., by the first user device 204, system provider device,or any other device) from previous conversation(s) between the firstuser 202 and the first person 206 stored in a database (e.g., aconversation assistance information database). In one example, theconversation history information indicates that the last conversationbetween the first user 202 and first person 206 happened over a monthago in a business setting. The first user device 204 may determine thatthe first user 202 needs conversation assistance information ofinformation types for the name, employer, and job title of the firstuser 202 according to the information type 462 of conversation historysetting 456 c associated with the last conversation time and setting ofthe last conversation.

While the analysis of the determination of the need for conversationassistance and information types has been discussed as being performedin the first user device 204, in some embodiments, the conversationinformation may be sent to the system provider device and then analyzedby the system provider device to determine a need for conversationassistance and information types, while remaining within the scope ofthe present disclosure. Furthermore, while a variety of specificinformation uses has been described to determine whether to provideconversation assistance and what type of conversation assistance toprovide, different combinations of conversation information, as well asother information not discussed explicitly above, may be utilized in themethod 100 while remaining within the scope of the present disclosure.

Referring now to FIGS. 1 and 5A-5C, the method 100 now proceeds to block106, where conversation assistance information associated with the firstperson is retrieved. Conversation assistance information of variousinformation types may be retrieved from various information sources.Referring now to FIG. 5A, an embodiment of a conversation assistancesystem 500 with various information sources is illustrated. Theconversation assistance system 500 includes a system provider device 502communicatively coupled through a network 504 to the first user device204 and the broadcast user device 208. The system provider device 502 isfurther communicatively coupled to a conversation assistance informationdatabase 506. While illustrated as a single database that is directlyconnected to the system provider device 502, the conversation assistanceinformation database 506 may be provided in multiple databases, and/ormay be coupled to the system provider device 502 by the network 504. Thesystem provider device 502 is further communicatively coupled to a firstsocial network 508 a and a second social network 508 b. In someembodiments, the system provider device 502 may receive conversationinformation from the first user device 204 and may further analyzeconversation information received from the first user device 204 (e.g.,the audio information, body measurement data, gesture information,etc.). In some embodiments, the system provider device 502 may determinethat the first user 202 needs conversation assistance in conversation200 and conversation assistance information types needed by the firstuser 202.

In some embodiments, the system provider device 502 may selectinformation sources (e.g., the social networks 508 a and 508 b, thebroadcast user device 208, the conversation assistance informationdatabase 506, other information sources, and/or combinations thereof)for retrieving conversation assistance information according to theinformation types needed by the first user 202 and the specificinformation types provided by respective information sources. In someembodiments, different information sources may provide conversationassistance information that includes different information types. Insome embodiments, instead of retrieving conversation assistanceinformation of all information types from all information sources, thesystem provider device 502 only retrieves conversation assistanceinformation from selected sources, which may improve the performance(e.g., in computation bandwidth, speed, power consumption) of theconversation assistance system 500.

In some embodiments, the broadcast user device 208 may provideconversation assistance information of specific information types (e.g.,for a name, a real time speaking status, a look (discussed furtherbelow), and/or a real time location), which may be determined accordingto broadcast settings. Referring now to FIG. 5B, in some embodiments,the first person 206 involved in the conversation 200 may configurebroadcast user device 208 to broadcast conversation assistanceinformation of specific information types associated with the firstperson 206 according to broadcast settings including information typesettings. As illustrated in FIG. 5B, broadcast user device 208 includesa display 512 displaying a broadcast settings screen 514 that includesan information type settings section 516 including information typesettings 522 a, 522 b, 522 c, 522 d, and 522 e. Each information typesetting 522 a-e includes an information type 518 and a broadcast enabledstatus 520. In the examples illustrated in FIG. 5B, the information typesettings 522 a, 522 b, 522 c, and 522 d provide that broadcast isenabled for information types that include the name, the real timespeaking status, the look, and the real time location of the firstperson 206. On the other hand, the information type setting 522 eprovides that broadcast is not enabled for information type for thechild of the first person 206.

In some embodiments, the broadcast settings may include social networkconnections range settings, which may be used by the broadcast userdevice 208 to determine its broadcast range. As illustrated in FIG. 5B,broadcast settings screen 512 includes a social network connectionsrange settings section 524 including social network connections rangesettings 526 a and 526 b. In the example illustrated in FIG. 5B, thesocial network connections range setting 526 a provides for thebroadcast of communication assistance information to users with a first,second, or third degree connection of the first person 206 via a socialnetwork. In another example, the social network connections rangesetting 526 b provides for the broadcast of communication assistanceinformation to users included in a social network provided by FACEBOOK®and a social network provided by LINKEDIN®. Using the specific exampleof the broadcast settings illustrated in FIG. 5B, if the first person206 would like to save the broadcast settings (e.g., on the broadcastuser device 208, on the system provider device 502, or any otherdevice), the first person 206 may select the “SAVE” choice 528 in thebroadcast settings screen 514.

In some embodiments, the conversation assistance information database506 may include conversation assistance information of specificinformation types (e.g., for the name, last conversation time, lastconversation location, event, job title, employer, wife, children,description, and/or conversation history), which may be determinedaccording to configurations of the conversation assistance informationdatabase 506. Referring now to FIG. 5C, an embodiment of a conversationassistance information database 506 including a conversation assistanceinformation table 530 is illustrated. The conversation assistanceinformation table 530 is associated with the first user 202. In theillustrated example, the conversation assistance information table 530may include columns that provide a name field 534, a time field 536, alocation field 538, an event field 540, a job title field 542, anemployer field 544, a wife field 546, a children field 548, anddescription field 550 for any of a plurality of rows in the conversationassistance information table 530 that identify a previous conversation532 involving the first user 202. Each column may correspond to aninformation type. In the illustrated example, conversation assistanceinformation corresponding to two previous conversations 532 a and 532 binvolving the first user 202 and the first person 206 (e.g., Donald) isstored in the conversation assistance information table 530. As such,information captured during previous conversations by the user 202 maybe stored in the conversation assistance information database 506 andprovided during current and/or subsequent conversations as conversationassistance information to the user 202. Furthermore, information in theconversation assistance information database 506 may be provided to auser during a current conversation based on a variety of factors. Forexample, information (e.g., a name) associated with a conversationseveral weeks before between the user and a person may be provided tothe user upon a new conversation with that person, while the sameinformation associated with a conversation a few hours before betweenthe user and a person may not be provided to the user upon a newconversation with that person.

In some embodiments, each of the social networks 508 a and 508 b mayprovide conversation assistance information of specific informationtypes (e.g., for connections in the social network, employer, and/or jobtitle), which may be determined according to configurations of thesocial networks. In one example, conversation assistance information ofan information type for connections in a social network may be availablefrom the first social network 508 a. In another example, conversationassistance information of information types for the employer and jobtitle may be available from the second social network 508 b (e.g.,LINKEDIN®).

In some embodiments, the system provider device 502 may retrieveconversation assistance information of the one or more information typesneeded by the first user 202 from selected information sources. In oneexample, the first user 202 may need conversation assistance informationof information types that include the name, employer, and children of aperson. In a specific example, the system provider device 502 may thenretrieve the name information from broadcast user device 208, theemployer information from the second social network 208 b, and thechildren information from the conversation assistance informationdatabase 506.

Referring now to FIGS. 1 and 6, the method 100 now proceeds to block108, where a conversation assistance information configuration isretrieved (e.g., from the first user device 204, the system providerdevice 502, or any other device).

In some embodiments, the conversation assistance informationconfiguration may include discreet configurations to provide fordiscreet provision of conversation assistance information to the firstuser 202 (e.g., through the at least one first user device 204) in anongoing conversation 200 so that, for example, other persons involved inconversation 200 (e.g., the first person 206) do not notice that thefirst user 202 is asking for and/or receiving conversation assistance.Referring now to FIG. 6, embodiments of various discreet configurationsare illustrated. As illustrated in the example of FIG. 6, the first userdevice 204 includes a display 402 displaying a conversation assistanceinformation configurations screen 600 including a discreetconfigurations section 602. The discreet configurations section 602includes various discreet configurations 604 a, 604 b, 604 c, 604 d, and604 e. For example, as illustrated in FIG. 6, the discreet configuration604 a provides images for corresponding names (e.g., images of a duckfor the name “Donald,” keys for the name “Keith,” a bee for the name“Abby,” and tiles for the name “Kyle”). In another example, the discreetconfiguration 604 b may provide for displaying the conversationassistance information (e.g., the name of the first person 206) in anassistance language (e.g., Chinese) that may be different than thelanguage being spoken in the conversation 200. In another example, thediscreet configuration 604 c may provide for vibrating the first userdevice 204 in code (e.g., Morse code) for the conversation assistanceinformation (e.g., the name of the first person 206). In anotherexample, the discreet configuration 604 d may provide for making a fakephone call to the first user 202 and displaying the conversationassistance information (e.g., the name of the first person 206) as thecaller identifier displayed on the at least one first user device 204.In another example, the discreet configuration 604 e may provide forusing audio in an earphone of the at least one first user device 204 toprovide the conversation assistance information. In some embodiments,specific discreet configurations may be enabled or disabledautomatically according to the availability of required devices (e.g.,an earphone) or functions (e.g., vibration), or according to the firstuser 202's personal preferences provided by the first user 202.

Using the specific example of the conversation assistance informationconfigurations illustrated in FIG. 6, if the first user 202 would liketo save conversation assistance information configurations includingdiscreet configurations 604 a-604 e (e.g., on the first user device 204,on the system provider device 502, or any other device), the first user202 may select the “SAVE” choice 606 in the conversation assistanceinformation configurations screen 600.

In some embodiments, the conversation assistance informationconfiguration may include a non-discreet configuration, which may beused to provide conversation assistance information associated withpotential conversation participants.

Referring now to FIGS. 1, 7, and 8, after a conversation assistanceinformation configuration has been retrieved, the method 100 may proceedto block 110, where the conversation assistance information includinginformation types needed by the first user 202 is provided to the firstuser 202 through the at least one user device 204 according to theconversation assistance information configuration.

In some embodiments, the conversation assistance informationconfiguration includes the discreet configurations 604 for providingconversation assistance information during conversation 200 discreetly,and the system provider device 502 may adapt the conversation assistanceinformation according to the enabled discreet configurations 602 (e.g.,discreet configuration 604 a of FIG. 6). In one example, theconversation assistance information includes a name “Donald.” Ifdiscreet configuration 604 a is enabled, an image (e.g., a duck) for thename adapted using discreet configuration 604 a is displayed on thefirst user device 204. In another example, if discreet configuration 604b is enabled, a name in the assisted language (e.g., “

”, or “Donald” in Chinese) adapted according to discreet configuration604 b is displayed on the first user device 204. In another example, ifdiscreet configuration 604 c is enabled, the first user device 204vibrates according to the Morse code for “Donald” according to discreetconfiguration 604 c. In another example, if discreet configuration 604 dis enabled, the first user device 204 receives a fake phone calldisplaying a caller identifier (e.g., “Donald,” or “

” if discreet configuration 604 b is also enabled). In another example,if discreet configuration 604 e is enabled, the first user 202 receivesaudio of “Donald” in an earphone of the first user device 204.

Referring to FIGS. 7 and 8, in some embodiments, the conversationassistance information is provided to the first user 202 through thefirst user device 204 according to non-discreet configurations. In oneexample, when the first user 202 arrives at a specific event, the firstuser 202 may be provided with conversation assistance informationassociated with potential conversation participants (e.g., according topersons connected to the first user 202 in social networks at thespecific event, and/or location data from broadcast user devices at thespecific event). Unlike providing conversation assistance informationduring an ongoing conversation, conversation assistance informationassociated with potential conversation participants may be providedaccording to non-discreet configurations, and more information types maybe retrieved and/or provided to the first user 202.

Referring now to FIG. 7, an embodiment of conversation assistanceinformation associated with one potential conversation participant isprovided to the first user device 204. As illustrated in the example ofFIG. 7, the first user device 204 includes a display 402 displaying apotential conversation participant(s) screen 700 including aparticipants section 702. In the example illustrated in FIG. 7, only onepotential conversation participant 714 has been discovered (e.g., basedon persons connected to the first user 202 in social networks at thespecific event) and displayed in the participants section 702, and theconversation assistance information may be displayed according to anon-discreet configuration for a single potential conversationparticipant. The participants section 702 displays conversationassistance information of various types, including name 704 (e.g.,“DONALD”), look 706 (e.g., an image of Donald), and connections 708between the first user 202 and the potential conversation participant714 (e.g., retrieved from first social network 508 a).

In some embodiments, the potential conversation participant(s) screen700 includes a family section 710 including conversation assistanceinformation of information types (e.g., wife, children) related to thefamily. In some embodiments, the potential conversation participant(s)screen 700 includes a conversation history section 712 includinginformation about previous conversations (e.g., retrieved fromconversation assistance information database 506) involving the firstuser 202 and the potential conversation participant 714.

Referring now to FIG. 8, conversation assistance information associatedwith multiple potential conversation participants 714 a, 714 b, and 714c is provided to the first user device 204. As illustrated in theexample of FIG. 8, the first user device 204 includes a display 402displaying a potential conversation participant(s) screen 700 includinga participants section 702. In the example illustrated in FIG. 7, at thespecific event, the three potential conversation participants 714 a, 714b, and 714 c are discovered (e.g., based on location data provided bybroadcast user devices used by the potential conversation participants),and conversation assistance information associated with the threepotential conversation participants 714 a, 714 b, and 714 c aredisplayed in the participants section 702. The conversation assistanceinformation may be displayed according to a non-discreet configurationfor multiple potential conversation participants. In addition to theinformation types (e.g., name 704, look 706, connections 708) displayedfor a single potential conversation participant in FIG. 7, theparticipants section 702 includes connection 716 indicating connectionsbetween the potential conversation participants 714 a and 714 b.

In some embodiments, the participants section 702 includes speakingstatus 718 indicating the real time speaking status (e.g., retrievedfrom a broadcast user device carried by the potential conversationparticipant 714 a) of the potential conversation participant 714 a. Insome embodiments, the participants section 702 includes a locationsection 720 including relative location indicators 722 a, 722 b, and 722c for respective potential conversation participants. In one example,the relative location indicator 722 a indicates that potentialconversation participant 714 a is immediately in front of the first user202. While the speaking status 718 and location indicators 722 areprovided in an example of the identification of potential conversationparticipants, such features may be provided as conversation assistanceinformation to the user 202 during a conversation with multiple people.For example, the user 202 may be in a conversation with multiple people,and the techniques described above may be utilized to identify each ofthose people similarly as illustrated in FIG. 8, while also providingthe relative location of each person (via the location indicators 722a-c) and the speaking status 718. As such, a user may quickly and easilydetermine information about a plurality of people in a conversation, andmay quickly distinguish information associated with those differentpeople based on which one is currently speaking.

Referring now to FIGS. 1 and 9, the method 100 may proceed to block 112where after the conversation 200 ends, a device (e.g., the first userdevice 204, the service provider device 502, and/or any other device)receives a conversation record of the conversation 200. In someembodiments, the user device may automatically update conversationassistance information database (e.g., using a speech recognition engineto analyze audio of the conversation record). In some embodiments, thefirst user 202 may review the conversation record (e.g., listening tothe audio of the conversation record) and update the conversationassistance information database. Referring now to FIG. 9, illustrated isa conversation assistance information database 506 including aconversation assistance information table 530 updated with theconversation record of the conversation 200. As illustrated in FIG. 9, atime 536, location 538, event 540, employer 544, children 548, anddescription 550 corresponding to the conversation 200 have been updatedto include information collected in conversation 200. In someembodiments, the information in the conversation assistance informationtable 530 may be provided for display to a user subsequent to aconversation to allow that user to review the details of a conversationthat may be important to remember.

Thus, conversation assistance systems and methods have been describedthat operate to assist a user engaging in a conversation by providingthat user with relevant information for use in that conversation. Thesystems and methods may use a variety of data to detect that aconversation is occurring, and then automatically retrieve and provideconversation assistance information to the user in a variety of ways toallow that user to use that conversation assistance in the conversation.For example, the system may discreetly detect that a conversation hasbegun via conversation initiate actions such as handshakes, and may alsodetermine that body measurement data (e.g., an increased heart rate,increased perspiration, etc.) indicates that the user may not know aname of the person with whom the user is starting the conversation. Thesystems may then retrieve the name of that person and provide itdiscreetly to the user so that they may use it during the conversation.Such systems and methods improve the ability of users to participate inconversations with people whom they may have forgotten relevant and/orimportant information about, thus enhancing the users' interactions withothers.

Referring now to FIG. 10, an embodiment of a network-based system 1000for implementing one or more processes described herein is illustrated.As shown, network-based system 1000 may comprise or implement aplurality of servers and/or software components that operate to performvarious methodologies in accordance with the described embodiments.Exemplary servers may include, for example, stand-alone andenterprise-class servers operating a server OS such as a MICROSOFT® OS,a UNIX® OS, a LINUX® OS, or other suitable server-based OS. It can beappreciated that the servers illustrated in FIG. 6 may be deployed inother ways and that the operations performed and/or the servicesprovided by such servers may be combined or separated for a givenimplementation and may be performed by a greater number or fewer numberof servers. One or more servers may be operated and/or maintained by thesame or different entities.

The embodiment of the networked system 1000 illustrated in FIG. 10includes a plurality of user devices 1002, a plurality of broadcast userdevices 1004, a system provider device 1006, and a plurality of socialnetwork service provider devices 1008 in communication over a network1010. Any of the user devices 1002 may be the user devices 204 discussedabove. The broadcast user devices 1004 may be the broadcast user devices208 discussed above and may be used by the first person 206 discussedabove. The system provider device 1006 may be the system provider device502 discussed above and may be operated by a system provider such as,for example, PayPal Inc. of San Jose, Calif..

The user devices 1002, broadcast user devices 1004, and system providerdevice 1006 may each include one or more processors, memories, and otherappropriate components for executing instructions such as program codeand/or data stored on one or more computer readable mediums to implementthe various applications, data, and steps described herein. For example,such instructions may be stored in one or more computer readable mediumssuch as memories or data storage devices internal and/or external tovarious components of the system 1000, and/or accessible over thenetwork 1010.

The network 1010 may be implemented as a single network or a combinationof multiple networks. For example, in various embodiments, the network1010 may include the Internet and/or one or more intranets, landlinenetworks, wireless networks, and/or other appropriate types of networks.

The user device 1002 may be implemented using any appropriatecombination of hardware and/or software configured for wired and/orwireless communication over network 1010. For example, in oneembodiment, the user device 1002 may be implemented as a personalcomputer of a user in communication with the Internet. In someembodiments, the user device 1002 may be a wearable device. In someembodiments, the user device 1002 may be a smart phone, personal digitalassistant (PDA), laptop computer, and/or other types of computingdevices.

The user device 1002 may include one or more browser applications whichmay be used, for example, to provide a convenient interface to permitthe first user 202 to browse information available over the network1010. For example, in one embodiment, the browser application may beimplemented as a web browser configured to view information availableover the Internet.

The user device 1002 may also include one or more toolbar applicationswhich may be used, for example, to provide user-side processing forperforming desired tasks in response to operations selected by the firstuser. In one embodiment, the toolbar application may display a userinterface in connection with the browser application.

The user device 1002 may further include other applications as may bedesired in particular embodiments to provide desired features to theuser device 1002. In particular, the other applications may include asocial network application provided by a social network service providerthrough the social network service provider device 1008. The otherapplications may also include security applications for implementinguser-side security features, programmatic user applications forinterfacing with appropriate application programming interfaces (APIs)over the network 1010, or other types of applications. Email and/or textapplications may also be included, which allow the user to send andreceive emails and/or text messages through the network 110. The userdevice 1002 includes one or more user and/or device identifiers whichmay be implemented, for example, as operating system registry entries,cookies associated with the browser application, identifiers associatedwith hardware of the user device 1002, or other appropriate identifiers,such as a phone number. In one embodiment, the user identifier may beused by the system provider device 1006 and/or social network serviceprovider device 1008 to associate the user with a particular account asfurther described herein.

Referring now to FIG. 11, an embodiment of a user device 1100 isillustrated. The user device 1100 may be the user devices 204 orbroadcast user device 208. The user device 1100 includes a chassis 1102having a display 1104 and an input device including the display 1104 anda plurality of input buttons 1106. One of skill in the art willrecognize that the user device 1100 is a portable or mobile phoneincluding a touch screen input device and a plurality of input buttonsthat allow the functionality discussed above with reference to themethod 100. However, a variety of other portable/mobile user devices maybe used in the method 100 without departing from the scope of thepresent disclosure.

Referring now to FIG. 12, an embodiment of a wearable user device 1200is illustrated. The wearable user device 1200 may be the may be thewearable user devices 204 or broadcast user device 208 discussed above.The wearable user device 1200 includes a frame 1202 having a computingchassis 1204 that extends from the frame 1202, a display device 1206that extends from the computing chassis 1204, a microphone 1208 locatedon the computing chassis 1204, a camera 1210 located on the computingchassis 1204, and a speaker 1212 located on the computing chassis 1204.One of skill in the art will recognize that the wearable user device1200 is a mobile wearable device such as, for example, Google Glass®available from Google Inc. of Mountain View, Calif. that may provide auser with the functionality discussed above with reference to themethods discussed above. However, a variety of other mobile wearabledevices may be used in the methods discussed above without departingfrom the scope of the present disclosure.

Referring now to FIG. 13, an embodiment of a computer system 1300suitable for implementing, for example, the user devices 204, broadcastuser device 208, and/or system provider device 502, is illustrated. Itshould be appreciated that other devices utilized by users, persons,and/or system providers in the system discussed above may be implementedas the computer system 1300 in a manner as follows.

In accordance with various embodiments of the present disclosure,computer system 1300, such as a computer and/or a network server,includes a bus 1302 or other communication mechanism for communicatinginformation, which interconnects subsystems and components, such as aprocessing component 1304 (e.g., processor, micro-controller, digitalsignal processor (DSP), etc.), a system memory component 1306 (e.g.,RAM), a static storage component 1308 (e.g., ROM), a disk drivecomponent 1310 (e.g., magnetic or optical), a network interfacecomponent 1312 (e.g., modem or Ethernet card), a display component 1314(e.g., CRT or LCD), an input component 1318 (e.g., keyboard, keypad, orvirtual keyboard), a cursor control component 1320 (e.g., mouse,pointer, or trackball), a location sensor component 1322 (e.g., a GlobalPositioning System (GPS) device as illustrated, a cell towertriangulation device, and/or a variety of other location determinationdevices known in the art.), a camera component 1323, a perspirationsensor component 1330, a heart rate sensor 1332, a motion sensorcomponent 1334, and/or a temperature sensor 1336. In one implementation,the disk drive component 1310 may comprise a database having one or moredisk drive components.

In accordance with embodiments of the present disclosure, the computersystem 1300 performs specific operations by the processor 1304 executingone or more sequences of instructions contained in the memory component1306, such as described herein with respect to the user device(s) 204,the broadcast user device(s) 208, and/or the system provider device(s)502. Such instructions may be read into the system memory component 1306from another computer readable medium, such as the static storagecomponent 1308 or the disk drive component 1310. In other embodiments,hard-wired circuitry may be used in place of or in combination withsoftware instructions to implement the present disclosure.

Logic may be encoded in a computer readable medium, which may refer toany medium that participates in providing instructions to the processor1304 for execution. Such a medium may take many forms, including but notlimited to, non-volatile media, volatile media, and transmission media.In one embodiment, the computer readable medium is non-transitory. Invarious implementations, non-volatile media includes optical or magneticdisks, such as the disk drive component 1310, volatile media includesdynamic memory, such as the system memory component 1306, andtransmission media includes coaxial cables, copper wire, and fiberoptics, including wires that comprise the bus 1302. In one example,transmission media may take the form of acoustic or light waves, such asthose generated during radio wave and infrared data communications.

Some common forms of computer readable media includes, for example,floppy disk, flexible disk, hard disk, magnetic tape, any other magneticmedium, CD-ROM, any other optical medium, punch cards, paper tape, anyother physical medium with patterns of holes, RAM, PROM, EPROM,FLASH-EPROM, any other memory chip or cartridge, carrier wave, or anyother medium from which a computer is adapted to read. In oneembodiment, the computer readable media is non-transitory.

In various embodiments of the present disclosure, execution ofinstruction sequences to practice the present disclosure may beperformed by the computer system 1300. In various other embodiments ofthe present disclosure, a plurality of the computer systems 1300 coupledby a communication link 1324 to the network 1010 (e.g., such as a LAN,WLAN, PTSN, and/or various other wired or wireless networks, includingtelecommunications, mobile, and cellular phone networks) may performinstruction sequences to practice the present disclosure in coordinationwith one another.

The computer system 1300 may transmit and receive messages, data,information and instructions, including one or more programs (i.e.,application code) through the communication link 1324 and the networkinterface component 1312. The network interface component 1312 mayinclude an antenna, either separate or integrated, to enabletransmission and reception via the communication link 1324. Receivedprogram code may be executed by processor 1304 as received and/or storedin disk drive component 1310 or some other non-volatile storagecomponent for execution.

Referring now to FIG. 14, an embodiment of a system provider device 1400is illustrated. In an embodiment, the system provider device 1400 may bethe system provider devices 502 discussed above. The system providerdevice 1400 includes a communication engine 1402 that is coupled to thenetwork 1010 and to a conversation assistance engine 1404 that iscoupled to a conversation assistance information database 1406. Thecommunication engine 1402 may be software or instructions stored on acomputer-readable medium that allows the system provider device 1400 tosend and receive information over the network 1010. The conversationassistance engine 1404 may be software or instructions stored on acomputer-readable medium that is operable to receive conversationinformation including body measurement data, determine a need forconversation assistance using the body measurement data and informationtypes needed by the first use 202, retrieve conversation assistanceinformation, provide the conversation assistance information to thefirst user 202, and provide any of the other functionality that isdiscussed above. While the databases 1406 and 1408 have been illustratedas located in the system provider device 1400, one of skill in the artwill recognize that it may be connected to the conversation assistanceengine 1404 through the network 1010 without departing from the scope ofthe present disclosure.

Where applicable, various embodiments provided by the present disclosuremay be implemented using hardware, software, or combinations of hardwareand software. Also, where applicable, the various hardware componentsand/or software components set forth herein may be combined intocomposite components comprising software, hardware, and/or both withoutdeparting from the scope of the present disclosure. Where applicable,the various hardware components and/or software components set forthherein may be separated into sub-components comprising software,hardware, or both without departing from the scope of the presentdisclosure. In addition, where applicable, it is contemplated thatsoftware components may be implemented as hardware components andvice-versa.

Software, in accordance with the present disclosure, such as programcode and/or data, may be stored on one or more computer readablemediums. It is also contemplated that software identified herein may beimplemented using one or more general purpose or specific purposecomputers and/or computer systems, networked and/or otherwise. Whereapplicable, the ordering of various steps described herein may bechanged, combined into composite steps, and/or separated into sub-stepsto provide features described herein.

The foregoing disclosure is not intended to limit the present disclosureto the precise forms or particular fields of use disclosed. As such, itis contemplated that various alternate embodiments and/or modificationsto the present disclosure, whether explicitly described or impliedherein, are possible in light of the disclosure. Having thus describedembodiments of the present disclosure, persons of ordinary skill in theart will recognize that changes may be made in form and detail withoutdeparting from the scope of the present disclosure. Thus, the presentdisclosure is limited only by the claims.

1. (canceled)
 2. A system comprising: a non-transitory memory; and oneor more hardware processors coupled to the non-transitory memory andconfigured to read instructions from the non-transitory memory to causethe system to perform operations comprising: detecting a plurality ofpersons associated with a user at an event; determining relativepositions of the plurality of persons with respect to a user device ofthe user; retrieving data related to the plurality of persons, whereinthe data related to each person in the plurality of persons comprisesinformation obtained from a previous conversation between the user andthe person; and providing, on the user device, an interface thatpresents at least a portion of the retrieved data related to theplurality of persons and the relative positions of the plurality ofpersons with respect to the user device.
 3. The system of claim 2,wherein the operations further comprise: detecting a real-time speakingstatus of each person of the plurality of persons; and presenting, viathe interface, the real-time speaking statuses of the plurality ofpersons.
 4. The system of claim 2, wherein the data related to a firstperson in the plurality of persons comprises a connection status betweenthe user and the first person within a social media site.
 5. The systemof claim 2, wherein the detecting the plurality of persons associatedwith the user comprises: obtaining an image of a scene at the event fromthe user device; determining that a group of people is in the scene byanalyzing the image; and determining that the plurality of personswithin the group are associated with the user based on a conversationhistory associated with the user.
 6. They system of claim 2, wherein theoperations further comprise: detecting that the user is having aconversation with a first person of the plurality of persons at theevent; obtaining conversation information associated with theconversation; and storing the conversation information.
 7. The system ofclaim 6, wherein the event is a first event, and wherein the operationsfurther comprise: detecting that the first person is at a second eventsubsequent to the first event; and in response to detecting that thefirst person is at the second event, presenting the conversationinformation obtained at the first event on the user device.
 8. Thesystem of claim 2, wherein the conversation information comprises atleast one of a family status, information associated with a familymember of the first person, a hobby of the first person, or a job titleof the first person.
 9. The system of claim 2, wherein the operationsfurther comprise: extracting, for a first person from the plurality ofpersons, a first portion of the retrieved data that identifies the firstperson, wherein the interface presents the first portion of theretrieved data for the first person; receiving, via the interfaceprovided on the user device, a selection of the first person; and inresponse to receiving the selection, presenting, on the interface, asecond portion of the retrieved data related to the first person.
 10. Amethod comprising: detecting, by one or more hardware processors, acomputing device of a person at a location, wherein the person isassociated with a user at the location; determining, by the one or morehardware processors, a relative position of the computing device withrespect to a user device of the user; retrieving, by the one or morehardware processors, data related to the person, wherein the datacomprises information obtained from a previous conversation between theuser and the person; and providing, by the one or more hardwareprocessors on the user device, an interface that presents the retrieveddata and the relative position.
 11. The method of claim 10, furthercomprising: determining one or more information types associated withthe person based on a conversation history between the user and theperson, wherein the retrieving the data is based on the one or moreinformation types.
 12. The method of claim 11, wherein the one or moreinformation types is determined further based on a time of a previousconversation between the user and the person.
 13. The method of claim11, wherein the determining the one or more information types comprisesdetermining a first information type when a previous conversationbetween the user and the person occurred prior to a predetermined timeand determining a second information type when the previous conversationbetween the user and the person occurred after the predetermined time.14. The method of claim 11, wherein the one or more information types isdetermined further based on a social setting of a previous conversationbetween the user and the person.
 15. The method of claim 10, wherein theretrieved data indicates whether the user is directly or indirectlyconnected to the person within a social network.
 16. A non-transitorymachine-readable medium stored thereon machine-readable instructionsexecutable to cause a machine to perform operations comprising:detecting a plurality of persons associated with a user at an event;determining relative positions of the plurality of persons with respectto a user device of the user; retrieving data related to the pluralityof persons, wherein the data related to each person in the plurality ofpersons comprises information obtained from at least one previousconversation between the user and the person; and providing, on the userdevice, an interface that presents at least a portion of the retrieveddata related to the plurality of persons and the relative positions ofthe plurality of persons with respect to the user device.
 17. Thenon-transitory machine-readable medium of claim 16, wherein theoperations further comprise: detecting a real-time speaking status ofeach person of the plurality of persons; and presenting, via theinterface, the real-time speaking statuses of the plurality of persons.18. The non-transitory machine-readable medium of claim 16, wherein thedata related to a first person in the plurality of persons comprises aconnection status between the user and the first person within a socialmedia site.
 19. The non-transitory machine-readable medium of claim 16,wherein the detecting the plurality of persons associated with the usercomprises: obtaining an image of a scene at the event from the userdevice; determining that a group of persons is within the scene byanalyzing the image; and determining that the plurality of personswithin the group is associated with the user based on a conversationhistory associated with the user.
 20. They non-transitorymachine-readable medium of claim 16, wherein the operations furthercomprise: detecting that the user is having a conversation with a firstperson of the plurality of persons at the event; obtaining conversationinformation associated with the conversation; storing the conversationinformation; and presenting content on the user device at a subsequentevent based on the conversation information.
 21. The non-transitorymachine-readable medium of claim 16, wherein the interface presents therelative positions of the plurality of people with an identifier of acorresponding person associated with each of the plurality of people.